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Introduction 



There is a reason why I have entitled this presentation Towards a 
Comprehensive Method for Evaluating Social Studies Curriculum Materials. The 
evaluation methodology is still very much “a work in progress”. My purpose is 
to develop a method for evaluating social studies curriculum materials that 
encompasses both the materials’ comprehensibility and the perspective offered. 

I have drawn from past evaluations focused on either comprehensibility or 
perspective that have not typically encompassed both types of evaluation. 

There are examples of studies for comprehensibility such as those done by Beck 
and Mckeown (1991), Armbruster and Anderson (1984), Brophy (1990) and 
White (1988). There are examples of studies for perspective as well, such as 
those by Anyon (1978,1983), Billington (1966), Taxel (1984), Levstik (1990) and 
others. 

My first application and use of this comprehensive evaluation 
methodology is with two of the original textbooks series for elementary school 
social studies that were published in the 1930s and 1940s by Paul R Hanna 
with others and Harold O Rugg with his then wife Louise Krueger. I anticipate 
using this evaluation in the future with other materials, modem as well as 
historical, fiction and non-fiction tradebooks, videos and computer resources as 




2 



3 



well as textbooks and materials at levels other than elementary. Through this 
use I anticipate refining and developing the methodology further. 

Overview of the Method of Evaluation 

As a general overview, my evaluation methodology will determine whether 
the curriculum materials are age appropriate, educationally significant and give 
the perspective of groups of people important to the topic. A content goal is 
necessary for each topic being evaluated. This content goal serves as a model 
for age appropriate and educationally significant information on the particular 
topic. 

For my first use of the evaluation, I chose three topics from the Hanna 
and Rugg texts; pre-industrial Pacific Island societies, specifically Samoa and 
New Guinea, Dutch colonial New York and the beginnings of industrialization in 
the eighteenth century English textile industry. An example of the process of 
determining a content goal that is age appropriate, educationally significant and 
includes important groups is shown in the decisions I made about a content 
goal for Dutch colonial New York at the fourth grade level. 

Dutch colonial New York has a vast area of content that is not 
educationally significant to the topic at this grade level. Large amounts of 
information on seventeenth century history can be considered part of the 
content, but would not be educationally significant for elementary school 
(Flinders, Noddings and Thornton, 1986). For example, it is important for 
fourth grade students to realize that the major European powers during the 
time of New York’s original settlement were in an intense rivalry over trade 
routes and the acquisition of colonies. Some of this rivalry played itself out in 
the establishment of the fur and tobacco trade in New York, the introduction of 
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settlers to protect New Amsterdam as a Dutch trading post and the eventual fall 
of Dutch New Amsterdam to the English. 



There is much more to these rivalries, however, particularly as they 
occurred on a world stage. There was intermittent warfare between England 
and Holland and Spain throughout the period that the Dutch controlled New 
York. Some of the hostilities occurred in Europe, some in the East Indies, some 
in the West Indies and some on the coast of Africa. The actual takeover of 
Dutch New Amsterdam by the English was part of a broader Anglo-Dutch War 
being waged in Europe (Archdeacon, 1976; Goodfriend, 1992; Homberger, 1994; 
Lunt, 1957; Meinig, 1986). 

Determining the key concepts and ideas to be covered in this topic and 
the degree of detail for an elementary student is a judgment decision. It seems 
reasonable to assume that in the fourth grade it is important to understand the 
basic nature of the rivalry between European countries. Included should be an 
understanding of the importance at that time of spices for food flavoring and 
preservation, the use of furs for clothing and the acquisition of gold as 
currency. Why countries wanted colonies should also be understood. To go 
into minute detail at this level about the variety of political ramifications of 
these rivalries seems unnecessarily complex and therefore not educationally 
significant for a discussion of Dutch colonial New York in fourth grade. 
Therefore, these details on the rivalries between European countries are not 
included in my content goal for this topic. 



Another example of a content goal for a topic in the Hanna and Rugg 
textbooks is industrialization in the eighteenth century English textile industry. 

ti | * v » » ' 

The following is an outline of the important concepts and supporting facts that I 
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felt were educationally significant and age appropriate for this topic. The level is 
sixth grade. The information was obtained from general texts on the beginnings 
of industrialization that can be found in a university library or a good public 
library (Ashton, 1968/1997; Mantoux, 1928/1961; Mokyr, 1998; Lunt, 1957). 



Concepts and Facts 
For 

Industrialization in the Eighteenth Century English Textile Industry 

♦ Economic change is gradual and occurs over centuries, not years. 
Economic change is evolutionary not revolutionary. 

♦ The Nature of Economic Change to Industrialization 

• The change from human muscle to mechanical power 

• The development of specialized tasks in the manufacturing of 
goods 

• The development of the factory system 

♦ Certain conditions were necessary for industrialization to occur in 
England in the eighteenth century: 

• An increase in population that provided laborers for new 
industries: 

♦ Population growth was effected by a decrease in the 
death rate and an increase in birth rates 

♦ There was better nutrition because better crops were 
introduced that provided better food to eat (the potato is 
an example) 

♦ There was wider distribution of crops for food because 
the transportation system was improved with the 
building of canals and better roads 

♦ There were improvements in personal hygiene and 
medicine, such as the use of a vaccination against 
smallpox 

♦ Small farmers did not have to spend all of their time 
growing food for survival and had time available for 
other work 



A division of labor existed before industrialization 



♦ 

♦ Peasants would complete part, but not all, of the 
process of manufacturing in their homes (called 
cottage industry). 

Examples are: 

The use of spinning wheels to spin thread 
The use of hand looms to weave cloth 

♦ Advances in transportation: 

♦ New road systems and canal systems were developed 
within England 

♦ Faster ships were developed for ocean transportation 
between England and other countries 

♦ It was now possible to purchase raw materials and sell 
finished goods in a much wider area. Previously 
purchase and sales had not extended beyond the local 
town and regional marketplaces. 

♦ An increase in available capital and new inventions: 

♦ People had extra income that they didn’t need to spend 
just to survive 

♦ Wealthy people were willing invest money in new 
inventions that were powered by wind, water or 
steam, not human muscle 

♦ New inventions created the factory system 

❖ New machines, such as the power loom for 
weaving cloth, were too big to be housed in 
workers’ homes 

♦ Specially designed buildings called factories 
were built to house the new machines 

♦ New machinery was the result of the work of 
many individuals 

♦ A successful invention, such as the power 
loom, was the result of many previous 
unsuccessful attempts to apply power 
other than human muscle to weaving on a 
loom 

♦ New inventions were not the result of one 
man’s work 
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♦ Industrialization of manufacturing and the factory 
system created two distinct economic classes, owners 
and workers 

Perspective 

Major Groups involved in Industrialization 
Owners of the New Factories 
Workers in the New Factories 
Workers in Cottage Industries 

Workers within Different Specialties, such as Spinners and Weavers 
Consumers of the Manufactured Cloth, particularly Women 



Having accomplished the first step of creating a content goal for the 
evaluation, the next step is to conduct the evaluation itself using the content 
goal as a model for information that should be in the materials and using 
different categories as an assessment guide for comprehensibility and 
perspective. The written evaluation itself is qualitative and follows Eisner’s 
(1991) idea of educational connoisseurship and criticism. The writing in this 
type of qualitative evaluation uses thick and vivid description and interpretation 
in order for th^ reader to see what the evaluator sees. 

The categories for evaluating comprehensibility include: 



1) The adequacy and explicitness of main concepts 

2) The presence of asides in the text passage that distract from the main concept 

3) The adequacy of examples and comparisons used to develop the passage’s main 
concept 

4) The presence of causal relationships (a cause followed by a consequence). 

5) A sense of time appropriate to the target grade level 

6) No understatement of important information 



